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Abstract Schulman|T] has argued that Boltzmann's intuition, that the psy- 
chological arrow of time is necessarily aligned with the thermodynamic arrow, 
is correct. Schulman gives an explicit physical mechanism for this connection, 
based on the brain being representable as a computer, together with certain 
thermodynamic properties of computational processes. Hawking[2j presents 
similar, if briefer, arguments. The purpose of this paper is to critically exam- 
ine the support for the link between thermodynamics and an arrow of time 
for computers. The principal arguments put forward by Schulman and Hawk- 
ing will be shown to fail. It will be shown that any computational process 
that can take place in an entropy increasing universe, can equally take place 
in an entropy decreasing universe. This conclusion does not automatically 
imply a psychological arrow can run counter to the thermodynamic arrow. 
Some alternative possible explanations for the alignment of the two arrows 
will be briefly discussed. 

Keywords Landauer's principle; arrow of time; causality; computers 



1 Introduction 

In part of his response to Zermelo's reversibility objections to statistical me- 
chanics, Boltzmannp] suggested it was possible (indeed, inevitable) to have 
extended regions of space, and time, that were entropy decreasing, but that 
living beings within those regions would be unable to perceive the difference: 

For the universe, the two directions of time are indistinguishable, just 
as in space there is no up and down. However, just as at a particular 
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place on the earth's surface we call "down" the direction toward the 
center of the earth, so will a living being in a particular time interval 
of such a single world distinguish the direction of time toward the 
less probable state from the opposite direction (the former toward the 
past, the latter toward the future) 

Authors such as[ll[5] have developed this idea while others [S'>'T,'5] are critical. 

As noted in [9] [Chapter 12], the perception of 'up' and 'down' can be 
directly traced to particular physical processes in different creatures (and 
specifically in the case of humans, the effect of the gravitational field on the 
fluid of the inner ear) . While it may seem implausible that there could be an 
equivalent organ, which monitors the local entropy gradient, and informs the 
brain in which direction time is flowing, there remains the possibility that 
there is still something about the general functioning of the brain that can 
only take place in the direction of entropy increase. 

In a recent paper Schulman[T] claims to identify such a function from the 
general thermodynamic properties of computations, as physical processes. 
He gives a detailed comparison of the components of a computer with the 
features of the psychological arrow to show 

the extent to which a computer . . . can be said to possess a psycholog- 
ical arrow. My contention is that the parallels are sufficiently strong 
as to leave little room for an independent psychological arrow. 

He then appeals to Landauer's Principle [ID] to show that the intrinsic arrow 
of computational processes must be aligned with the thermodynamic arrow. 
As a result a computer is 

without an independent arrow of time, retaining the past/future dis- 
tinction by virtue of its being part of a mechanistic world with a 
thermodynamic arrow in a particular direction. 

Similar suggestions to Schulman's can be found in [TTlfT2j l2| 

when a computer records something in memory, the total entropy 
increases. Thus computers remember things in the direction of time 
in which entropy increases. In a universe in which entropy is decreasing 
in time, computer memories will work backward. [2] 

It is argued in this paper that neither Hawking nor Schulman's arguments 
hold. 

The structure is as follows. First (Section ^ we will state how we will 
treat the thermodynamic arrow of time, and what we mean when we refer to 
an 'entropy increasing universe' and an 'entropy decreasing universe'. Then 
(Section [3]) we consider what it takes for a physical process to embody a 
computation and the effect of a time reversal of this physical process. The 
processes that result from this temporal reversal are not equivalent to the 
processes that can represent a computation. We then show the key result that 
equivalent operations to the time reversed processes can be constructed, so 
the time reverse of those equivalent operations is a computation in a time 
reversed universe (Section 13. 4p that is equivalent to the original computa- 
tion. This demonstrates the physical possibility of such processes in entropy 
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decreasing universes, and gives us a model to further study the possibihties 
of computation under such circumstances. 

In Section |3.5[ we examine the derivation of Landauer's Principle in an 
entropy decreasing universe. We find that the physical assumptions required 
for an entropy decreasing universe result in a reversal of the inequality that 
occurs in the usual statements of Landauer's Principle. Rather than necessi- 
tating entropy increases, when taking place in an entropy decreasing universe 
logical operations necessitate entropy decreases. In retrospect this will seem 
rather obvious. 

Finally (Section [4]) we consider the question of whether systems which 
gather, process and utilise information, are simply more likely to arise in 
entropy decreasing or entropy increasing universes. We examine this from 
the point of view of volume of state space arguments, to see if there is, all 
else being equal, any reason to expect that entropy decreasing universes are 
inherently hostile to the gathering and retention of information. We find 
that, perhaps surprisingly, they are not. We conclude that, on the basis of 
statistical mechanical arguments alone, we have no grounds for linking any 
computational arrow of time to the thermodynamic arrow of time. 

Given the clear manner in which our own information processing seems 
aligned to the thermodynamic arrow, this may seem puzzling. We will briefly 
consider some possible explanations of this link, but which would require 
more complex arguments to justify. A surprising conclusion might be that, 
if the psychological arrow of time is necessarily aligned with the thermody- 
namic arrow, then it cannot be logically supervenient upon computational 
states. Alternatively, if the psychological arrow of time is logically superve- 
nient upon information processing, then it must be logically independent of 
the thermodynamic arrow. 



2 The Thermodynamic Arrow 

First it is necessary to make clear what is meant by an entropy increasing 
universe and an entropy decreasing universe. 

The state space of the universe is formed from the product of the state 
spaces of a large number of smaller systems SI — Y[i®^i and a measure, /z, 
on regions of the state space. It will be usually only be necessary to consider 
grouping the subsystems into a small number of distinct, larger subsystems, 
J, with most of the small subsystems grouped into a single 'environment', E: 

nj = Y[ (1) 

iej 

^E = Y[ (2) 

ieE 

n = S2eY[ (3) 

j 

The dynamics are described by an invertible, measure preserving flow t/)^*^ 
on the state space. For any region A C [2 then (Z\)) = IJ,{A), and there 

exists a map <^"(*) such that o (Z\) = o ^-(*)(Z\) = A. 
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2.1 Entropy increasing universe 

An entropy increasing universe has a microstate that starts in a very small 
and special region Aq C Q. It is assumed that the dynamics of the flow 

on the state space is such that, over time, this region spreads out over the 
state space. As the measure is preserved, this can only happen by the region 
developing a very elongated and filamentary structure. As part of the special 
nature of the initial region, it will be assumed that the fine detail of this 
elongated and filamentary structure can be ignored for any future evolution 
of the system. 

The initial region is a direct product of regions over the subsystems: 

^0 = n '^^i 

i 

After the system has evolved, it will not, in general be the case that the 
evolved region (/)'^*^(Z\o) is a direct product of regions over the subsystems. 
Instead there will be microscopic correlations. The appearance of entropy 
increase will be represented by the coarse graining out of these microscopic 
correlations. 

We will assume that the state space J7j of each subsystem, i, is divided 
into distinct subregions ujij, such that UjWjj = Oi. A direct product of a set 
of subregions across all the subsystems: 

= n '^^hrii (4) 
i 

can be represented by the array of integers n = (ni, . . . , rij, . . .) . 

(/)(*)(Z\o) is the coarse grained representation of 0(*)(Z\o). This is defined 
to be the smallest superset of (Z\o) that can be represented by a union of 
some set, {n}, of direct products over the subsystems and a direct product 
with a subset of the environment. It will be of the form 

<^(*) {Ao) C <^(*)(Z\o) = U„Z„ Ae (5) 

Let the sets {zi^ ^. } and {A'^} be the sets of all the regions that satisfy: 

4,™, C u;i,m, (6) 
A'e C (7) 

and for which there exits some set {m} such that 

i 

(P^'\Ao)CUrnA'^^A'E (9) 
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The set {n} and subregions Ai^m G {Z\- } and Z\_e G i^'^} that satisfy 
the conditions 

^» = n (1°) 

<^(*)(^o) c u„Z„®Zb (11) 

U„Z„ ® Zij C U„Z\^ ® Ziis (12) 

V{m}, Z\^, give the coarse graining of 0'*^(Z\o). 

In an entropy increasing universe, we assume that the microscopic corre- 
lations that develop due to </>'■*•' play no role in the future evolution of the 
system. In effect, this means that we may make the coarse grained replace- 
ment 

(zio) ^ U„Z„®Zb (13) 

for all future evolution of the system. 

The requirement that the initial state Aq is such that it produces all these 
results, for all realistic maps will be referred to as the initial boundary 
condition, and the resulting evolution as being in an entropy increasing uni- 
verse. For the purposes of this paper it will be assumed that these conditions 
can be met. 

When looking at the interactions of localised systems at times long af- 
ter the initial boundary condition, but long before complete thermalisation 
(which occurs at some future time Uh), this is represented by: 

1. No initial microscopic correlations between macroscopic subsystems; 

2. Thermal states are represented by Gibbs distributions at the start of any 
interaction. 

3. Microscopic correlations develop between the subsystems; 

4. The sum of the Gibbs entropies of the marginal distributions of the macro- 
scopic subsystems, increases; 

5. The microscopic correlations become, for all practical purposes, inacces- 
sible and may be coarse grained away; 



2.2 Time reversal and symmetry 

For clarity, we now state explicitly what we will mean by time reversal and 
by time symmetries. 

The time reversal of a dynamical system involves taking the time ordered 
sequence of regions. At, generated by the flow At — t/)'-*^ (Z\o)j time reversing 
each individual state, then reversing the order in which the states occur. This 
generates a new time ordered sequence of regions Axt- 

First we need the notion of the time reversal of the state space. This is 
not unproblematic (see [13] [Chapter 1] , for example) but for the purposes of 
this article let us assume that there is no disagreement over the time reverse 
of a state in our state space. The time reversal of the state space is a map 

= T{A) C n such that fi{A'^) = Ai(Z\) and A = ToT{A). For subsystems 
T{1\^ (X)Z\,) = Hi ^T{A^) and for subspaces T(U„Z\„) = U„r(Z\„). We also 
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note a A C B then C and for all state spaces 12 we consider here 

Reversiiig the order in which the states occur, about the time t — to, 
corresponds^ to t 2to — t. Combined we have the sequence of regions Axt = 
T{A2to~t) = ro0(2to-t) At t = the sequence is at Ato = ro,/.(2«o)(/\g) 
so Aq — 0^(2to) o T{Ato)- Combined, we have the time reversed dynamical 
map «!>rto(^): 

Two special cases may be more familiar. Firstly, for to = we have 

Secondly, for a transformation 0(^*0) ^ which takes place over the time period 
< t < 2to, then a reversal a,t t = to has the transformation 

It is important to note one cannot use the coarse grained description 
UxAx (S> Ae, defined in the previous section, for the time reversed dynamics. 
This coarse graining is valid, in the original dynamics, only for later times so 
is valid only for earlier times in the time reversed dynamics. 

We now define time reversal invariance and time translation invariance of 
the dynamics, although unless explicitly stated, we will not be assuming any 
of these invariances hold. We explicitly state them so that it may be clear 
where we have not needed to assume them. 

The dynamics are time reversal invariant at to iff 

4*]jZi) = 0W(Z\) (15) 
Weak time translation invariance is defined as 

> 0, s > o (1)^'^ (A) = (A) (16) 
and strong time translation invariance as 

yt, s o (A) = (zi) (17) 

Strong time translation invariance implied = 4>^~^\ and this in turn 

implies (t^rlS^) = To (j>^-*) o T{A) for aU to- 
ll a dynamics is time reversal invariant at all times, it is necessarily strong 
time translation invariant: 

(Vto 4i (^) = <^'*^ (^)) (Vi, s o (zi) = (Zi)) (18) 

If a dynamics is strong time translation invariant and time reversal in- 
variant at a single time, then it is necessarily time reversal invariant at all 
times. 

((Vt,s o</,(^)(Z\) ^ 0(*+^)(Zi)) & {3h\4\{A) - (Zi))) ^ (Vto 4\M) = <^^*^(^)) 

09) 

^ We need: t = to ^ t = to and t — t = 2to. 
^ As stated previously, i^'*' is invertible. 
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2.3 Entropy decreasing universe 

Now we must consider what it means to be in an entropy decreasing universe. 
Broadly, this must exhibit the time reversal of the behaviour that defines an 
entropy increasing universe. Wc must postulate the existence of a future 
boundary condition, that at some future time r, the state of the universe 
will be in the region of state space Zig and with a suitable dynamics. 

The most general means of doing this is to consider the time reversal, 
at t/2, of entropy increasing universes. Take the time ordered sequence of 
regions of state space in entropy increasing universes, At = 0^*'(Z\o)) with 
final region A-^ = <P'^'^\Aq). The time reversed dynamics is 

Art = <P^Tr/2i^To) = T o o O T{Ato) (20) 

The initial condition, in the entropy decreasing universes, is the time reversal 
of the final condition of the entropy increasing universes: Ato = T{At) = 
T o (^(^)(Z\o). So the time ordered sequence of regions of entropy decreasing 
universes is given by: 

Z\Tt=To</,(-*)(Z\o) (21) 

If the dynamics arc time reversal invariant at t/2, then 4>t't/2 ~ ^^'^ 

Art = oTo(/)M(Z\o). 

The coarse graining now works in reverse. Over the course of the evolu- 
tion of the system, fine grained structure, of an elongated and filamentary 
kind, appears. This fine grained structure played no role in the evolution of 
the system prior to its appearance. However, its appearance allows the region 
of state space to evolve into smaller regions that its initial, coarse grained, 
appearance would have indicated. In thermodynamic terms, this can be char- 
acterised by a universal tendency for heat to spontaneously flow out of the 
environment and cause masses to be raised through gravitational potentials. 

When looking at the interactions of localised systems at times long before 
the future boundary condition, t = t, but long after the universe has come 
out of complete thermalisation, t = t — tth, this wiU be represented by the 
reversed set of conditions: 

1. A high degree of initial microscopic correlations between macroscopic 
subsystems. 

2. Microscopic correlations disappear over the course of the interaction; 

3. The sum of the Gibbs entropies of the marginal distributions of the macro- 
scopic subsystems, is decreasing; 

4. The microscopic correlations which disappear, played no role in the ear- 
lier evolution of the system. In the future evolution of the system, new 
microscopic correlations come into play; 

5. Thermal states are represented by Gibbs distributions at the end of any 
interaction. 

We have been considering regions of state space, and the time ordered 
sequences of regions of state space. Any given universe follows only a single 

trajectory, a time ordered sequence of individual states. Reversing the tra- 
jectory of a given universe necessarily reverses every single time asymmetric 
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arrow associated with that universe. When asking whether a particular time 
asymmetric arrow is a consequence of the thermodynamic arrow, we cannot 
answer the question by simply time reversing the trajectory of our particular 
universe. Instead we must look at all the trajectories associated with the time 
ordered sequences of regions in the entropy increasing and decreasing cases, 
and then see if the arrow we are interested in turns out to have the same 
alignment to the thermodynamic arrow for all (or most) such trajectories. 



2.4 Time symmetric boundary conditions 

Schulman|I3] has considered the problem of universes with two time bound- 
ary conditions. Although the possibility of such a universe remains questionable [151 
[16], it will be useful to consider such a situation here. In these conditions there 
is a requirement both that the universe begins in the special initial region of 
state space Aq, and at a remote future time r ends in the special final region 
of state space Aq. 

A simple time reversal is not sufficient to deal with this. The possible 
trajectories of the system are those that pass through (f)^'^'>{Ao) H T{Ao) at 
t = T. Equivalent conditions are Aq n o T{Ao) at < = or (Ao) PI 

To4;/2^(Zio) at i = r/2. 

Schulman argues that, provided the time span t/2 is much greater than 
the complete thermalisation time tth, then during the epoch < t < tth the 
universe will be indistinguishable from an entropy increasing universe, and 
during the epoch t — tth < t < t the universe will be indistinguishable from 
an entropy decreasing one. 



3 The Computation Arrow 

A physical computation is a physical embodiment of a combination of logical 
operations. A logical operation is an abstract mathematical operation which 
takes a finite number of distinct input logical states, {a}, and maps them 
to a finite number of distinct output logical states, Conventionally the 
input logical state uniquely determines the output logical state, but there 
may be many input states corresponding to the same output state. If this is 
the case, the operation is called logically irreversible [lO]. 

We shall call a device logically irreversible if the output of a device 
does not uniquely define the inputs. 

If each (3 output state has only one possible a input state, then the operation 
is called logically reversible. 

The basic operations we need to consider are the NOT operation and 
the RESET TO ZERO (RTZ) operations (see Tables [D and The RTZ 
operation is perhaps less familiar than logical operations such as AND, OR. 



^ For completeness we include the identity or DO NOTHING operation, IDN, in 
Table El 
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Nevertheless, all standard logical operations can be built from suitable combi- 
nations of these two operations, and they arc the most widely studied logical 
operations from the point of view of thermodynamics. 



NOT 



IN 


OUT 





1 


1 






Table 1 Logical NOT 



RTZ 



IN 


OUT 








1 






Table 2 Reset to Zero 



IDN 


IN 


OUT 








1 


1 



Table 3 Logical Iden- 
tity 



The physical embodiment of a logical operation is a physical process, that 
starts with the system in one of a finite number of distinct regions of state 
space and evolves the system into one of a finite number of distinct regions of 
state space. The distinct regions of state space represent the input and output 
logical states. The same region can (and often will) represent both an input 
and an output state. The process embodies the logical operation precisely 
when states in the region of state space corresponding to an input logical 
state always end in the region of state space corresponding to the output 
logical state that results from the action of the logical operation upon that 
input logical state. 

To analyse the thermodynamics, take a state space fi = fls ® ^e, which 
is the product of the logical processing system and environment f^E 
state spaces. In an entropy increasing universe, we assume the environment 
is initially in some region Eq C Oe and there are no correlations with the 
system. Each input logical state a is represented by a region of the state 
space of the system Aa C i^s, such that Aa fl Aa' = for a a'. Similarly 
each output logical state /3 is represented by a region of the state space of 
the system Ap C f2s, such that Ajs n Api = for /? 7^ /?'. It is usually the 
case, and we will assume it here, that the input and output states of a logical 
operation are time reversal invariant subspaces: A'^ = A^ and A J = A/}. 

If the logical operation L maps logical states a /3, then the dynamic 
map acting over the duration II, embodies that operation if, and only 

if, Va A /3 

</>i*''^ (A„ rg) Eo) Q Ap (g, [2e (22) 

At the start of the physical operation, the system will be in one of the 
regions that represents one of the input logical states 

Ao = UaAa (8> ^0 (23) 

At the end of the physical operation, the system and environment will be 
located in the region: 

At^ = (P^I^\Ao) = VJa4>t\Acc ® Eo) C UpA^ Qe (24) 

In an entropy increasing universe, we assume that microscopic correlations 
between the system and the environment play no future role. If we are not 
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considering time reversals, therefore, for future evolutions of the system we 
can replace At,^ with the coarse grained region: 

At^ = UpAp Et^ (25) 

where VE' C He such that At^ C U/^Ap ® E' , then 

At^ C U13A13 ® Et^ C UfsA/j ® E' (26) 

3.1 Temporal reversal 

We will now need to consider how the physical embodiment of a logical 
operation is affected by a temporal reversal. We will find there is an apparent 
temporal asymmetry in some of these physical processes. 

The temporal reversal of the physical operation, at time ^i^, involves the 
system and environment starting in the region of state space Af^ = T(Z\t^), 
with the evolution (/>^*]^(Z\) = To,/.^*^"*) o,/.;;;^*^^ or(Z\). This gives 0^^^(Z\) = 

T o (t)i}*''"^ o T{A) for the complete operation, acting over < t < II- 
By definition 

T o <P^I'-\Ao, (E> Eo) ^ Afi He (27) 

and 

(t o (I>^1'-\Ac, ® Eo)) ^ A^ (g) E^ C Ac, ® f2E (28) 

(f>XL^ has acted as a map from the system being in one of the regions of 
state space corresponding to a logical state (3 to being in a region of state 
space corresponding to the initial logical state a. This is what we expect 
from a temporal reversal. 

If the operation was logically reversible, then for each p there was only 
one a for which A^ was mapped to A/3. A/3 is then mapped back to A^ by 

(^^^^ The temporal reversal operation acts upon each A/3 and mapping it to 
a specific Aa- It is embodying the inverse logical operation to L. 

Logically irreversible operations are not invertible functions. There will be 
more that one region A^, which was mapped to a given Ap by the operation 

L. The effect of the map 0^^'' on the region will be to map it into 
several different Aa regions. Where L is a logically irreversible operation, 
4>t'l does not appear to be the physical embodiment of a logical operation. 
There appears to be a fundamental temporal asymmetry in the physical 
embodiments of logical operations. 

3.2 Indeterministic operations 

To better understand the time reversal of logically irreversible operations, we 
need to widen the class of operations we are considering, to include indeter- 
ministi^ operations [TS]: 



* While indeterministic operations can be well defined, and can always be em- 
bodied by physical processes, it has been argued that indeterministic operations do 
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We shall call a device logically indeterministic if the input to a device 
does not uniquely define the outputs. 

The time reversal of the logically reversible IDN and the NOT opera- 
tions result in the IDN and NOT operations, respectively. Time reversal of 
logically irreversible RTZ, however, results in the indeterministic operation 
Unset From Zero (UFZ) in Tabled Note that the operation UFZ does fulfil 
the requirement of logical reversibility, above. For completeness, we also add 
the indeterministic, irreversible operation Randomise (RND) in Table O 



UFZ 



IN 


OUT 











1 



Table 4 Unset From Zero 



RND 



IN 


OUT 











1 


1 





1 


1 



Table 5 Randomise 



A computation is not simply a sequence of operations. It is an ordered 
sequence of particular logical operations. If a Universal Turing Machine is 
constructed out of a collection of physical processes implementing a par- 
ticular set of logically deterministic operations, the time reversal of those 
physical processes certainly does not produce the same set of operations. If 
the Universal Turing Machine was constructed using deterministic, logically 
irreversible operations, the time reversal would not include any logically irre- 
versible operations but would include indeterministic operations. This would 
not be a Universal Turing Machine. 

Logically irreversible operations may be simulated by logically reversible 
operations, but under time reversal this still does not recover the original 
computation. The logically reversible simulation of the RTZ operation is 
given in Table [6l and its time reversal in Table [71 



IN 


OUT 


IN 


OUT 














1 1 


1 


1 


1 1 



Table 6 Simulating RTZ 



Table 7 Simulating UFZ 



The time reversal is not a reversible simulation of RTZ, it is a deter- 
ministic simulation of UFZ. Although, in this case, both simulations can be 
achieved by the same logical operation (the CNOT gate), the particular op- 
eration that is being simulated changes. A sequence of operations simulating 

not count as logical operations( 17 , for example), although indeterministic opera- 
tions are required for computational complexity classes such as BPP, and so form 
a part of computational logic. As this point is not important for the discussion 
here, we will reserve 'logical operation' for logically deterministic operations in this 
paper, and refer to logically indeterministic operations as simply 'indeterministic 
operations'. 
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irreversible operations becomes a sequence of operations simulating indeter- 
ministic operations. If the Universal Turing Machine was constructed using 
deterministic, logically reversible operations, simulating logically irreversible 
operations, the time reversal would not include any simulations of logically 
irreversible operations but would include simulations of indctcrministic oper- 
ations. This would still not be a Universal Turing Machine. The time reversal 
of a Universal Turing Machine is not a Universal Turing Machine. So it would 
appear that a computation, as a physical process, may have an arrow of time. 



3.3 Logical reversal 

With the concept of indctcrministic operations in place, we can define a new 
concept, the logical reversal of an operation. A logical operation, L, has the 
logical reversal operation. which has the same mapping on the logical 
states, as the temporal reversal of a physical implementation of the original 
operation L. If the operation L maps the input state a to the output state /?, 
then the logical reversal maps /3, as an input state to a, as an output state. 
When L is a logically irreversible operation, there are many a mapped to a 
given (3, so RL will be a logically indeterministic operation, as it may map (3 
to one of many a. Similarly, if L is a logically indeterministic operation, then 
RL will be a logically reversible operation. Unlike the temporal reversal, the 
logical reversal acts in the same time direction as the original operation. 

We construct RL, first by defining proportions (according to a measure 
II on the state space) of the states acted up by the operation L, that start 
and end in the regions representing the logical states. The system starts in 
the region Aq = {JaAa^Eo and ends in the region Zi^^ = ^^^^(UcAq, (8)£o)- 

1. That start in logical state a 



WL{a) = 



n{{Aa(»nE)riAo) 

m(^o) 



2. That end in logical state /3 given they started in a 



((A^ (g, He) n ® Oe) n A^) 



1^ {{Ac, <E} ^e) n Z\o) 



3. That start in logical state a and end in logical state (3 





/«(^o) 



4. That end in logical state (3 



Wl{(3) = 



/X (g) n A J 
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5. That started in logical state a, given that they ended in logical state /3 

fi (^{A/s ® He) n (g) He) n A^) 



WL{a\f3) = 



ii{{A0(E,nE)nAt^) 



These proportions satisfy the expected relationship Wiict, (3) = WL{(3\(x)WL{ot) 
WL{a\P)WL{(3). For logically deterministic operations 

WL{a\(})€ {0,1} 

while for logically reversible operations 

Wi(/3|a)e{0,l} 

We do not include input or output states with measure zero, so Wi,(a) ^ 
and Wl{P) 7^ 0. If W^i,(q:|/3) = for the measure /i, it will be zero for all other 
measures, absolutely continuous with jj,, that are preserved by the dynamics. 
Equivalent statements also hold true for Wi,(a|/3) = 1, WL{l3\a) = and 
WL{P\a) = 1. 

Now consider the temporal reversal TL of this physical process. This acts 
upon logical states /? and produces logical states a, with proportions 



WTL{a,P) = 
Wtl{q) = 



II (<P^TLi^0 ^e) n (A„ Qe) n ^0) 

M((A/3(8)r2B)n Az,) 
/i ((t>''i''i\Ai3 (8> Oe) n {Ao, ® Qe) n Zio) 

iji {{Ag (S) ^e) n Aq) 

At (0^*]^^ {Ap ® f^is) n (A„ ® He) n A 



^ (g) r^is) n z\o) 

It is straightforward to show that as 

Wtl{I3) = WL{f3) 

then 

WTL{a) = WL{a) 

and 

WTLma) = WL{(3\a) 
It is also clear, by definition, that the temporal reversal of TL is just L: 

TTL = L 
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We will now define the logical reversal operation of L, as a map from the 
set of logical states {/?} to the set of logical states {a}, 

w 

in the same time direction as L, with a dynamic map (jl'^'j^ such that WiiL{oi\(3) 
WTL{ci\P) = Wl{oi\P)- The system is initially in the region Aq = [JfjAfj® Eq 

n{{Ai3 ® 12b) nylo) 



and ends in the region At^ = (/!)^j^^(ylo). The map should satisfy: 



WRL{a\(3) 

WRL{a) 
WRLiPla) 



A* {'pRL n (A„ ® He) n At^ 

II {<l>'kLiAi3 o /2b) n (A„ ® f^s) n At^ 
m(^o) 

/z((A„<8)^E)nylt^) 



/x((^„(8>f2E)nylt^) 
Again, it is straightforward that 

Wrl{I3) = Wl{P) 

leads to 

WRL{a) = WL{a) 

and 

WRL{l3\a) = WL{P\a) 

By definition 

RRL = L 

There is a straightforward method for constructing (j)RL- 

1. Partition each /? region into {a, (3) subregions, A^ = UaA(^a\0)j with 
A(^a\i3) n ^(a'l/3) = , 0! 7^ a' such that 

M (a, 13) 

2. The evolution of the system must prevent transitions between the subre- 
gions 

<^(^(a|/3)) n ^(^(a'l^o) = Va 7^ a', /? ^ /?' 

3. Define regions by joining the a subregions together, from difi^erent (i 
regions 

^'oi = U/3^(a|/3) 

and remove barriers to transitions between subregions with the same a 
value. 
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4. Evolve the distinct a regions to their final location in state space: 

Further refinements are necessary for thermodynamic optimisation. Explicit 
physical processes by which the operations UFZ and RND can be con- 
structed and optimised are given in |18j and for generic operations in [191 

US]. 



3.4 Computational reversal 

We will now consider sequences of operations, in a normal entropy increasing 
universe. We will not specify the particular set of operations. Our objective is 
not to consider the properties of a particular sequence of logical operations, 
or even of any sequence of logical operations intended for a particular pur- 
pose. We wish to consider the properties of any process that can be defined 
exclusively in terms of logical operations acting upon sets of logical states. 

In this general situation, we will start with a set of logical states {ao}. 
This is acted on by some logical operation Lq, and mapped to the set of 
output states {ai}. As we are in an entropy increasing universe, we may 
assume that any microscopic correlations that have developed between the 
information processing apparatus and the environment play no role in the 
future evolution of the system. The next logical operation Li then maps the 
logical states {ai} to the logical states {ct2}, and so on. 

This leads to a time ordered sequence of logical operations, and the se- 
quences of logical states which can occur as a result of these operations: 

{ao} ^ {ai} ^ . . . ^ {ai} . . . {a/} 

We will refer to this sequence as Si{Li}. 

We now consider the entropy decreasing universe that results from a time 
reversal. In the time reversed, entropy decreasing universe, this computa- 
tional sequence becomes S2{TLi}: 

{"/} ... -> {a^} ... ^ {ao} 

As we have noted in Sections l3.1l and the sequence of operations S2{TLi}, 
involving the time reversed TL operations, will not, in general, resemble the 
same computational process as Si{Li}. If Si{Li} is representing the logical 
operations performed by a Turing machine, there is no guarantee that the 
sequence of operations S2{TLi} resembles a computation at all. 

We now return to the original entropy increasing condition, and construct 
a physical system in an entropy increasing universe that implements the 
operations {RLi}, the logical reversals of the operations {Li}. Staring with 
initial logical states {cky}, a measure /i such that the physical representation 
of the states have weights W^^l^ (q/) = WLf{af), and the reversal operations 
{RLi}, such that WiiLi{ai-i\ai) = WLi{ai-i\ai), this leads to the time 
ordered computational sequence S3{RLi}: 

RLf RLf-i -RX,+i RLi RLi r , 

{"/} ^ {af-i} ... ^ {a,} -> ... ^ |ao} 
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Again, this sequence is quite distinct from Si{Li}. As a sequence of oper- 
ations, acting upon the logical states, it is identical to S2{TLi}, as RLi, 
by definition, implements the same operation from the set of states {a^} to 
{ai_i} as does TLi. However, as noted S2{TLi} need not resemble a com- 
putation and so neither need S^lRLi}. 

Now we complete the central argument of the paper. The time reversal of 
the universe containing the sequence S^lRLi}, gives the sequence S4{TRLi}: 

r T TRLi f , TRL2 TRL^ , , TRLi+i TRL; 

{"ol ^ {ail ^ ... {a,} ... ^ {a/} 

This is now in an entropy decreasing universe. However, it follows straight- 
forwardly from the definitions above, that TRLi = RTLi = Li, so S4{TRLi} 
is 

{ao} {aij ^ ... ...^{a/} 

The time ordered sequence S4{TRLi} is exactly the same set of logical oper- 
ations as Si{Li}, performed in the same order, and on the same set of logical 
states. S4{TRLi} takes place in an entropy decreasing universe. 

For any computational process consisting of a sequence of logical opera- 
tions on a set of logical states, in an entropy increasing universe, the same 
computational process is possible in an entropy decreasing universe. Although 
we were able to conclude in Section [3?2l above, that computational processes 
may have an intrinsic arrow, it does not appear to be the case that this arrow 
must be aligned with the thermodynamic arrow. 



3.5 Landauer's Principle 

Landauer's Principle is used as the basis for almost all conclusions regarding 
the thermodynamic properties of physical computation, yet the conclusion 
of the previous section seems to run counter to many widespread statements 
of this Principle: 

To erase a bit of information in an environment at temperature T 
requires dissipation of energy > fcTln2. [20l[2T] 

in erasing one bit ... of information one dissipates, on average, at least 
fcBTln(2) of energy into the environment. [22] 

a logically irreversible operation must be implemented by a physically 
irreversible device, which dissipates heat into the environment [23j 
erasure of one bit of information increases the entropy of the environ- 
ment by at least fc In 2 [2T [pg 27] 

any logically irreversible manipulation of data . . . must be accompa- 
nied by a corresponding entropy increase in the non-information bear- 
ing degrees of freedom of the information processing apparatus or its 
environment. Conversely, it is generally accepted that any logically 
reversible transformation of information can in principle be accom- 
plished by an appropriate physical mechanism operating in a thermo- 
dynamically reversible fashion. |25| 

Computations arc accompanied by dissipation . . . Landauer has shown 
that computation requires irreversible processes and heat generation. [1] 
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It is Landauer's Principle on which Schulman basis the ahgnment of the 
thermodynamic and the computational arrows of time. 

If Landauer's Principle is truly regarded as "the basic principle of the 
thermodynamics of information processing" [25] , how does this reconcile with 
the argument of the previous Section, that exactly the same information 
processing operations can take place in an entropy decreasing, as an entropy 
increasing universe? Does the computer act as a kind of Maxwell's Demon, 
dissipating heat against overall the anti-entropic direction? 

The answer is, straightforwardly, no. As has been noted many times 
before [26 j l27 l l28j . Landauer's Principle is not really a principle. It is a the- 
orem, of statistical mechanics, derived p2 l l29 1 [T7 l [T9] on the assumption that 
the computation is taking place in an entropy increasing universe. All justi- 
fications of Landauer's Principle, from [10] onwards, make this assumption. 
We will briefly review the derivation of Landauer's Principle in an entropy 
increasing universe, to see how the derivation turns out in an entropy de- 
creasing universe. 

3.5.1 Entropy increase 

The states of the physical system embodying logical state a will be repre- 
sented by density matrix pa, and I3hy pp. We assume^ that the input logical 
states {a} and output logical states {/3} are represented by states of physical 
systems with the same entropy S and mean energies U , so that Va, (3: 



The input logical states occur with probability Pa, and the logical operation 
is defined by the probabilities P{j3\a). 

In an entropy increasing universe, we make the following assumptions: 

1. The evolution of the system and environment is described by Hamiltonian 
dynamics, composed of internal energies of the system Hs and environ- 
ment He, together with an interaction potential Vse'- 



2. The environment is initially in a Gibbs canonical state, at some temper- 
ature T, and there are no initial correlations between the system and the 
environment. 



S = -fcTr [pa In [pa\] 
U = Tr [Hspa] = 



-fcTr [pp In [pp]] 
Tr [Hspp] 



(29) 
(30) 



H = Hs®Ie + Is®He + Vse 



Pe{T) 



(31) 



Tr [e-HE/kT^^ 




(32) 



a 



^ This is normal practice in the thermodynamics of computation. In [19] this 
assumption is relaxed. The essential conclusions of this Section are not affected. 



18 



3. The interaction energy between system and environment is negligible both 
before 

Tr [VsePg] ~ 

and after 

Tr [VsEe-'"'p^e'"'] « 

the interaction. 

For the Hamiltonian H to embody the logical operation: 
Trs [e-^^Va ® PEiT)e'"'] = PiP\^)PP 

It is a well known calculation [5IJII5T1I32 l[^[T^ to show, using: 

PI = YP{a)Pa 

a 

P{P) = Y,P{P\a)P{a) 

a 

p'e = Trs [pt] 
that two inequalities follow: 

Tr [pj In [pj]] + Tr [pe{T) In [pe{T)]] > Tr [pp In [pp]] + Tr [p'^ In [p'^]] (33) 



Tr 



kT 



> Tr 



P£(T) fln[pB(r)] 



He 
kT 



which combine to give 



Tr[i7£pB(r)] Tr[i7Bpy 



34) 



(35) 



This yields the standard form of Landauer's Principle, in an entropy increas- 
ing universe: 

AQ > -AHkT ln{2) 

where AQ is the expectation value for the heat generated in an environment 
at temperature T and AH is the change in Shannon information over the 
course of the operation 



For logically deterministic, reversible computations, it is always the case 
that AH — 0. These operations do not need to generate heat. On the other 
hand, for logically deterministic, irreversible operations AH < and so the 
heat generated in the environment is always positive. This is the basis of the 
claim that logically irreversible operations must be entropy increasing. 

® In 27 , 18 , 19 it is argued that even this heat generation is not necessarily ther- 
modynamically irreversible. 
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3.5.2 Entropy decrease 

In an entropy decreasing universe, we would still make the assumptions that 
the input logical states {a} and output logical states {/?} are represented by 
physical systems with the same entropy and mean energies. The logical state 
a is represented by the density matrix p^, and (3 hy pf}, as before. The input 
logical states occur with probability Pa, and the logical operation is defined 
by the probabilities P(/3|a). 
We continue to assume: 

1. The evolution of the system and environment is described by Hamiltonian 
dynamics. 

H' = H'g (S, Ie + Is <S> H'e + 

2. The interaction energy between system and environment is negligible both 
before 

Tr[V^EPo]^0 

and after 



Tr 



iH't, 



iH't 







the interaction. 



but the imposition of a future boundary condition must require the local 

conditions to be: 

3. After the operation the environment is in a Gibbs canonical state, at some 
temperature T, and there are no final microscopic correlations between 
the system and the environment. 

Now, for the Hamiltonian H' to fulfil these conditions and embody the logical 
operation it is necessary that 



Tr, 



P{(3\a)P{a) 



and 



Using: 



ft =^P(/3|a)P(a)p^0PB(r) 

0,a 



Po 


= e^"''pte 


-iH't 


Pi 


= T^E [po] 




p'e 


= Trs [po] 


Ot 




a 


a)P{a) 


Pf 


= TVs [pt] 


= Y,P{(3)p„ 
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the two inequalities become 

Tr [pF In [pf]] + Tr [pe{T) In [pe{T)]] > Tr [pi In [pj] 



Tr [p'f In [p^] 



Tr 



> Tr 



pE{T)[\n[pE{T)] + ^ 



which combine to give 



Paying careful attention to the fact that pe{T) is now the final state of 
the environment the statistical mechanical calculation leads to: 

AQ < -AHkT ln{2) 

where AQ is the expectation value for the heat generated in an environment. 

For logically deterministic, irreversible operations AH < and so the heat 
generated in the environment is less than the positive number —AHkThi{2). 
For logically deterministic, reversible computations, AH = as before, but 
this now just means the heat generation must be less than zero. In an entropy 
decreasing universe, the derivation of Landauer's Principle yields a maximum 
heat generation. If less than the maximum heat is generated, then there will 
have been an uncompensated decrease in the entropy of the universe. 

This is, of course, exactly what we should have expected! In entropy 
decreasing universes, the physical processes which embody computations are, 
generically, entropy decreasing processes. There is no contradiction between 
the statistical mechanical basis of Landauer's Principle, and the conclusions 
of Section [O 



4 The Correlation Arrow 

It has been argued in the previous Sections that, although a computer may 
possess a computational arrow, its functioning as a physical process does 
not imply the alignment of that arrow with the thermodynamic arrow. The 
argument was based upon all the same computational operations that can 
take place in an entropy increasing universe being physically possible in an 
entropy decreasing universe. This still leaves open the possibility that it is 
much more likely for systems to develop which process information in the 
same direction as entropy increase, than systems which process information 
in the direction of entropy decrease. 

Turning to this question, the arguments will seem less concrete than in the 
previous sections. This is a consequence of the need to consider if cosmological 
boundary conditions, over the lifetime of the universe, on the state of the 
whole universe, may have influences on the localised behaviour of systems, 
operating over short timescales, at a time in between, and very far from, 
either initial or final state of the universe. It is unclear how secure the chain 
of reasoning involved in understanding such influences can be (see [7], for 
example, for a sceptical view). 

How might such an argument be constructed? Hawking[2J suggests: 
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If one imposes a final boundary condition . . . one can show that the 
correlation between the computer memory and the surroundings is 
greater at early times than at late times. In other words, the computer 
remembers the future, but not the past. 

Similar arguments are presented in [lllll2j . 

The acquisition of information requires an increase in the correlation be- 
tween the computer and its surroundings. A future boundary condition, as 
interpreted in Section 12. 3i requires correlations to decrease in time. To ex- 
plore this requires a move beyond the consideration of a computer as an 
information processor. We must take into account the nature of the informa- 
tion that the system processes. It is a system that acquires new information 
about its surroundings and interacts with its surroundings conditional upon 
the information it has acquired. Such behaviour has been characterised as an 
Information Gathering and Utilising System, or IGUS. 

4.1 Information Gathering and Utilising Systems 
The behaviour of an IGUS may be described as: 

1 . There is a correlation between the macroscopic states of the internal states 
of an IGUS and the macroscopic states of its surroundings. 

2. These macroscopic correlations occurred through an interaction of the 
system with the surroundings, in the past. At an earlier point in time 
the macroscopic correlations did not exist. The existing correlations are 
screened off by an earlier interaction. 

3. New macroscopic correlations develop over time through conditional in- 
teractions. These can change the macroscopic internal states of the system 
conditional upon the states of the surroundings, or change the states of 
the surroundings, conditional upon the internal states of the system. 

4. Any macroscopic correlations between the current state of the system 
and future states of its surroundings, are screened off by the existing 
correlations and interactions between system and environment that take 
place between the present and the future time. 

The argument of Hawking is that such behaviour is compatible with an initial 
boundary condition, but incompatible with a future boundary condition. 

We can examine this in two equivalent ways. The first is to consider an 
IGUS in an entropy increasing and in an entropy decreasing universe. The 
second way is to consider the time reversal of these two scenarios. This will 
give a information processing system which is the logical reversal of an IGUS, 
in an entropy decreasing and in an entropy increasing universe, respectively. 
We refer to the logical reversal of an IGUS as an RIGUS. The statement 
that an entropy decreasing universe is incompatible with the operation of an 
IGUS is equivalent to the statement that an entropy increasing universe is 
incompatible with an RIGU S. 

The question needing answering is whether an entropy increasing universe 
prefers systems resembling an IGUS over systems resembling an RIGUS. If 
so the same argument should support the existence of an RIGU S compared 
to an IGUS in an entropy decreasing universe. 
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The behaviour of an RIGU S will appear as: 

1 . There is a correlation between the macroscopic states of the internal states 
of an RIGU S and the macroscopic states of its surroundings. 

2. These macroscopic correlations will disappear through a conditional in- 
teraction of the system with the surroundings, at some point in future. 
At a later point in time the macroscopic correlations will not exist. 

3. There decrease in macroscopic correlations over time is through condi- 
tional interactions with the surroundings. These can change the macro- 
scopic internal states of the system conditional upon the states of the 
surroundings, or change the states of the surroundings, conditional upon 
the internal states of the system. 

4. Any macroscopic correlations between the current state of the system and 
past states of its surroundings is screened off by the existing correlations 
and interactions between the past time and the present. 

Fortunately we do not need to construct explicit models for an IGUS or an 
RIGUS. All we need to know is that either system must be constructed out 
of the kind of operations described in the previous sections. 

It is now necessary to draw a distinction between the environmental de- 
grees of freedom of a heat bath, and the macroscopic states of the surround- 
ings that a computer might be correlated with. The set {Ai\ refer to the 
internal logical states of the IGU S. The macroscopically distinct regions of 
the surroundings are {Bi}. We represent the inaccessible regions of the envi- 
ronment by a separate subsystem Qe, which has no macroscopically distin- 
guishable subregions. The overall state of the universe at time t is represented 
by A- 



4.2 Growth in correlations 

Acquisition of knowledge is represented in the following terms. At a time t\ 
the computer is in the blank state represented by while the surroundings 
are in one of the regions Bi. The region of state space is 

A,ti =Bi®Ao^ Et, (36) 

and the overall possible region is 

Ot, = U,B, «) Ao Et, (37) 

The acquisition of information requires an evolution between ti and t2 
for which: 

A,t, =(/'(*^)o</,-(*i)(AuJ CS, cx)^,^r2i5 (38) 

In an entropy increasing universe, we replace this by the coarse graining 
Bi^Ai^ Ei^t2 2 A,t2 . for which 

Bi^Ai^ Ei^t2 ^Bi^Ai® Elt^ (39) 

for all E'^ that satisfy: 

A2 CB,(S)Ai(S) El^t^ C B, (S) Ai (g) Qe (40) 
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The overall region is 

0t, =U(/)(*^) o0-(*i)(B,® (41) 

which has a coarse graining UiBi (g) Ai(E) Et2 2 6**21 such that 

Ui Bi(giAi(E, Et^ CBi(giAi(E, E'^.^ (42) 

for all E'f.^ that satisfy: 

Ot2 C UiBi (8) E'f^ C UiBi ^Ai^Os (43) 

Now let us consider the reverse procedure, that would indicate the exis- 
tence of an RIGUS. Start in Ai^n = -Bj ^4, (g) Et^ and perform the evolution 

At2 =<I>r"^° (l)~R'^\AiM ) C Si Ao i7£ (44) 
This leads to the coarse graining 

^i,t2 C Si ^i,t2 (45) 

and the overall region 

e/J = UiSi Et, (46) 

evolves into 

which has a coarse graining Uj-B, E^t2 2 ©t^, such that 

Ui Ao C Si E^J (48) 
for all such that: 

^ UiBi ^i S^^' C UiBi ^i 12b (49) 

4.2.1 Measures on marginals 

We now ask whether the requirement that an RIGUS starts in a correlated 
state, and removes those correlations, is less compatible with an entropy 
increasing universe than an IGUS. We will assume that the internal states 
of the IGUS and RIGUS have equivalent measures: ij.{Ao) — iJ.{Ai). 
First consider the measure of the initial states: 

M(0tJ = M0t1) (50) 

An immediate consequence is that volume of state space arguments will not 
be able to show preference for an IGUS over an RIGUS on the basis of one 
or the other being simply more likely to occur at ti. 

From the measure preserving nature of the evolution of the IGUS we 
have 

M(A,tJ = M(A,t2) (51) 
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while the coarse graining gives 

n{Bi)i^{AoMEt,) < tx{Bi)ti{Ai)n{Ei^t^) (52) 

Similarly 

M(©tJ = M0tJ (53) 
which when coarse grained gives 

Y,^^{B^)^i{Ao)^x{E^,) < Y^i,{Bi)i^{Ai)fx(Ei,t,) < ^M(BOM(^i)M(^fa) 

i i i 

(54) 

Using n{Ao) = iJ.{Ai), we get: 

Mi?. J < ^-^^^^^^ (55) 

While this might indicate an increase in entropy, we can easily get similar 
results for the RIGU S. The measures for the reverse interaction are 

n{Ai,t^) = l^{Ai,t,) (56) 
while the coarse graining gives 

^i{B^)^i{A^)^x{Et, ) < M(Si)M(^o)M(^i,t J (57) 

Similarly 

M(0«) = M0t1) (58) 
which when coarse grained gives 

Y^f^iBM^iMEu) < ^M(Si)M(^o)M(^M.) < ^M(Si)M(^o)M(^t.) 

i i i 

(59) 

and m(^o) = gives: 

M(i?*J < < ^(^,J (60) 

It is clear that this RIGU S interaction is just as entropy increasing as the 
IGUS interaction. The direct growth in macroscopic correlations of an IGU S 
is no more indicative of entropy increase than the reduction in macroscopic 
correlations associated with an RIGUS. 
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4-2.2 Micro- and macro- correlations 

The loss of microcorrelation with the environment is responsible for the in- 
crease in entropy. This happens both for the macroscopically correlating in- 
teractions of an IGUS and its reverse, RIGUS. What of the macroscopic 
correlations themselves? These arc the correlations which are supposed to be 
forbidden to develop within an entropy decreasing universe. 

While it is certainly true that the measure over the marginals increases 
during information acquisition: 

^ f^iBi) ^ f,{Aj) > ^ i,{Bi)f,iAi) = ^ i,{Bi)f,iAo) (61) 

i j i i 

(where we continue to assume n{Ai) = /x(Ao)) this is a qualitatively different 
kind of increase to that associated with microcorrelations. The coarse grain- 
ing over the microcorrelations, that corresponds to entropy increase, is asso- 
ciated with the inaccessibility of these microcorrelations. If the microscopic 
correlations were still accessible (in the manner of a spin-echo experiment) 
no entropy increase could be said to have occurred. 

In the case of the macrocorrelations, however, it is essential that the 
correlations be accessible. It is precisely because the coarse grained state 
is UiBi (g) (g) and not UiBi (g) UjAj (g) Et^, that the IGUS is said to 
have information about its surroundings. It is the correlation that represents 
the information, that enables to IGUS to utilise that information in its 
interactions and future behaviour. 

The transition: 

Ui Si Ai (g) Et^ UiBi (g Uj (g> Et^ (62) 

would represent a decorrelation, that would destroy the information that the 
IGUS held about the state of its surroundings. So the equivalent operation 
to the increase in entropy associated with losing microcorrelations, is not 
associated with an acquisition of information, but with its loss. 

Let us consider the process by which such decorrelation occurs. In an 
entropy increasing universe, each thermodynamically irreversible operation 
increases the entropy of the surroundings and environment. Noise causes 
the switching of the computer's internal states, or a switching (or change) 
of the environmental states. An IGUS must maintain the relevance of its 
information by protecting against changes and checking the accuracy of its 
information. As the environmental degrees of freedom become saturated, the 
existence of noise cannot be protected against and decorrelation becomes 
irreversible. The computer ceases to be able to function, as the universe 
approaches a maximum entropy heat death. 

Now it is precisely the fact that such irreversible decorrelation does not 
occur (except on very largo timcscalcs) , that normally makes the information 
gathered useful. The utilisation of acquired information requires the existence 
of stable, accessible, macroscopic correlations, so that the overall state, UjBj(g 
Ai cannot be replaced by the direct product of the marginal states, UiBi (g 
UjAj. By contrast, the increase in thermodynamic entropy is due to the loss 
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of microscopic correlations, which are presumed inaccessible. This means that 
the regions Zij,t2 = (p^*'^'^ {Bi(g)AQ(g)Et^) C i?j(g)Aj{g)J?£; can be replaced 

by the coarse grained, direct product of their marginal states, (g) (g) Ei^t2 ■ 
The role played by correlations in macroscopic information and microscopic 
entropy turns out to be of a quite different nature. 

4.3 No interaction, no correlation 

There remains an intuition that, nevertheless, the kind of evolutions char- 
acterised as an IGUS should still be more likely to occur that the kind of 
evolutions characterised by an RIGU S. We will examine this further by con- 
sidering a simple system, with two states of the environment Bi and two 
states of an IGUS, Ai. If we suppose the system goes through the following 
stages: 

^oO^o Ao(g>iBo e Bi) (Ao Bo)©(^i ® Bi) (Aq ffi Ai)®(Bo © Bi) 

(63) 

Initially the system is in the low entropy, uncorrelated state. The environment 
evolves into one of two possible states. The system then measures the state 
of the environment, becoming correlated. Eventually decorrelation leads to 
heat death. 

The reverse, RIGU S, would involve: 

^oO^o ^ (^0 O Bo)®{Ai O Bi) Ao(g)iBo Bi) ^ (^o e ^i)(8>(Bo ® -Bi) 

(64) 

At first sight, this evolution seems implausible. We start with the low entropy, 
uncorrelated state. Correlations spontaneously appear. The RIGUS removes 
these correlations, before noise, once again, leads to a heat death. 

The problem in constructing a justification for eliminating the RIGUS 
evolution on entropic grounds is that: 

^x{AoMBo) < m(Ao)m(So)+m(^i)m(Bi) = m(^o)(m(So)+m(Si)) < (m(Ao)+m(Ai))(m(Bo)+m(Si)) 

(65) 

the two intermediate states between the uncorrelated and the decorrelated 

states can have the same measure. 

Our intuition says that Ao^{Bo © Bi) will occur first rather than {Aq (g Bq)© 
{Ai (g) Bi). The spontaneously correlated state would require all initial states 
in ^0 ® Bq to evolve into cither ® Bq or Ai ® Bi. To achieve this it is 
necessary for a correlated interaction to take place. If it is the case that at 
t = 0, there is no correlation, and the two systems do not interact (or share 
interaction with any combination of intermediary systems) between t = 
and t = T, then 

(Ao ® i?o) = ^("^ (Ao) ® <^(") (Bo) (66) 

Whatever else might be the case, such an evolution cannot possibly induce 
a correlation. 

If it seems surprising that such a conclusion can be drawn so rapidly after 
the negative conclusion of the previous section, it is important to notice the 
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different. The entropic argument was based upon measures upon state space 
regions. This argument is based upon a restriction upon aUowed evolutions 
of the combined system. 

At first sight this might seem to provide the answer, neatly and simply. 
In an entropy increasing universe, the existence of macroscopic correlation at 
some intermediate time requires the existence of a macroscopic correlating 
interaction at an earlier time. By contrast, in an entropy decreasing universe, 
the existence of macroscopic correlations at the intermediate time requires 
the existence of a macroscopic decorrelating interaction in the future. This 
appears to bear out Hawking's' claim that macrocorrelations must decrease. 

However, there are problems when one considers more complicated situ- 
ations than the two state systems considered here. The no-interaction, no- 
correlation argument presented would rule out the development of micro- 
scopic correlations just as effectively as it rules out the development of macro- 
scopic correlations. In an entropy increasing universe, microcorrelations must 
develop, so it seems that the restriction of equation 1661 is simply too strong 
to represent the world. Once we allow microscopic correlations to be devel- 
oping, it is less clear what condition on the dynamics is necessary to ensure 
an RIGUS is less likely than an IGUS. 

It might also seem implausible that the non-existence of an RIGU S here 
and now, can genuinely be because of a boundary condition in the remote 
past. All the condition implies is that, given the existence of a macroscopic 
correlation now, that there must have been, some time between now and the 
start of the universe, a macroscopic interaction. It does not even guarantee 
that the systems which are correlated, now, are the ones that interacted in 
the past - only that there must have been an interaction in the past that has 
had causal influences upon the two systems now. 

In the time reversed situation, the future boundary condition is supposed 
to prevent the operation of an IGUS. However, all the future boundary con- 
dition actually guarantees is that, at some point in the future there must be 
a macroscopic interaction to remove the correlation. It does not guarantee 
that this interaction must involve the system currently correlated to its sur- 
roundings. Given the timescale involved for the future boundary condition 
to apply, there seems a long way to go to show that a remote final condi- 
tion is sufficient to rule out the existence of IGUS systems in an entropy 
decreasing universe. However, if true, this implies that a remote boundary 
condition has a more direct effect upon possible states now than just through 
the conditions given in Sections 12. II and 12.31 

The argument now begins to resemble attempts to base the causal fork 
asymmetry on entropic argument^. The literature on this topic is too large 
to consider here (see [4l[5l [T3l[33] and for criticisms see [34irfl[35] ) . However, 
to question how clear the argument is from a remote boundary condition to 
situations now, we will simply consider two scenarios. The first will be Schul- 
man's two time boundary condition, where both initial and future boundary 
condition constraints exist. The second will be a situation where a local 
entropy gradient exists, but without either an initial or future boundary con- 

^ Note, this cannot have been Hawking's intent, at least, as earlier in [2] he speaks 
dismissively of causality and the arguments of [4]. 
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dition. While these scenarios may be regarded as implausible, their purpose 
is to examine if there are gaps in the arguments based upon remote boundary 
conditions. 

4-3.1 Two time boundary conditions 

Suppose that we are in a two time boundary condition universe such as Schul- 
man proposes, but for which the thermalisation time is much greater than 
half the lifespan of the universe. In such a situation one might find an over- 
lap between the entropy increasing and decreasing portions of space-time. It 
may then be possible for a complex system, operating in a thcrmodynami- 
cally reversible manner, to operate in both temporal halves of the universe. 
Now suppose such a system is a computer is designed to work very close 
the thermodynamic reversibility, and can swap from a power source suitable 
for an entropy increasing universe to a power source suitable for an entropy 
decreasing universe. 

Why is it the case that, when the computer enters the entropy decreasing 
timespan, it ceases to operate as an IGUSl All we can say is that, ultimately, 
any information it gathers, must be lost again before the universe reaches its 
final low entropy state. That seems to leave a large amount of time over which 
it is able to function! Of course, such a scenario also allows the possibility 
of an equivalent RIGU S existing in the entropy increasing period of time. 
The emergence of such a RIGU S may be taken as an indicator that a future 
boundary condition exists. However, there seems no direct reasoning, from 
thermodynamics, to tell us how far in the future is such a boundary condition 
located. If this is the case, we equally cannot tell how long an IGU S will be 
able to continue to operate in an entropy decreasing universe. 

4-. 3. 2 Asymmetry without boundary conditions 

The crossover, from a entropy increasing to decreasing universe, raises addi- 
tional problems, if we are to consider the interactions between an IGUS and 
an RIGU S in the same region of space-time. We can remove this problem 
by considering another, rather exotic, situation, which questions whether a 
remote boundary condition could possibly be responsible for the absence of 
RIGUS systems. 

Consider a system, identical to the solar system except in two respects: the 
sun is not a sun, but a boundary that absorbs, scatters and emits photons 
and particles into the solar system, with exactly the same profile as our 
sun does; and around the solar system (just around the Oort cloud) there 
is another closed boundary, that absorbs, scatters and emits photons and 
particles into the solar system with the same profile as the radiation crossing 
a hypothetical surface enclosing our solar system. Now suppose that this 
completely enclosed system has been in this state indefinitely far into the 
past, and will be in this state indefinitely far into the future. 

Such a system is explicitly time asymmetric. The profile of the radiation 
being absorbed, scattered and emitted on the two boundaries is quite different 
when viewed in a time reverse direction. In a normal time direction the solar 
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boundary emits low entropy radiation, some of which falls upon an earth- 
like planet and is rcradiatcd in a higher entropy form. Most of the solar 
radiation, along with most of the earthly re-radiation is eventually absorbed 
by the Oort boundary, which radiates a negligibly small amount of radiation 
back (largely concentrated at small points) apart from a roughly symmetric 
emission and absorbtion of radiation at the cosmic microwave background 
frequency. Reversing the time direction will produce a quite different profile 
of emission and absorbtion on the two boundaries. 

Let us ignore issues, such as the question of the long term stability of the 
solar system and so forth, which are not directly relevant to the present day 
thermodynamics of our solar system. For much of the history of life on our 
earth, there has been a reasonably stable non-equilibrium state, maintained 
by the local entropy gradient between the radiation falling on earth, from 
our sun, and re-radiated out again. The enclosed solar system will be in a 
stable non-equilibrium state much like our solar system, including the earth- 
like planet. It would seem reasonable to expect conditions on the earth- like 
planet to resemble conditions on our earth. 

The principal argument of this paper has been that there appears noth- 
ing in the thermodynamics of the local conditions on the earth-like planet 
that prevents the existence of an RIGUS. The no-interaction no-correlation 
argument suggests that a remote initial boundary condition prevents it on 
our earth. However, in the enclosed solar system, there is no remote initial 
boundary condition. If an RIGU S is still not possible in the enclosed solar 
system, it miist be the case that there is something about the local entropy 
gradient that prevents it, rather than an initial boundary condition. 

If the remote initial boundary condition has an influence on the state 
of our earth only through the entropy difference between the incoming and 
outgoing radiation, then the cause of the absence of an RIGU S on earth 
must be the same as on the enclosed earth- like planet. We have found no 
explanation in terms of the local entropy gradient to prevent an RIGU S, so 
if the local entropy gradient screens off the effect of a remote initial boundary 
condition, then such a condition cannot provide an argument against the 
existence of an RIGU S on our earth. 

Alternatively, the remote initial boundary condition may have a direct 
effect on the conditions on earth today that is not screened off by the local 
entropy gradient. In this case it may prevent the existence of an RIGU S on 
our earth, but leaves the possibility of an RIGU S on the enclosed earth-like 
planet. It is hard to see what kind of process could supply such a direct 
effect, or how this would lead to conditions being so radically different on 
the enclosed earth-like planet, but one possibility might be the asymmetry 
of electromagnetic radiation, between advanced and retarded waves. 



5 NESS, not QSES. Complexity, not information 

Any process that is a sequence of Quasi-Static Equilibrium States (QSES) 

can, in principle, be connected by thermodynamically reversible processes (it 
is this that enables us to determine the entropy difference between them). 
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Let us consider a specific example: the paradigmatic ice cube melting in a 
glass of water, and the film of this being run backwards. 

There is nothing about the two states: an ice cube in glass; and a glass 
of water; that tells us one must come before the other. It is entirely possible 
in an entropy increasing universe, for the ice cube to be in the future of the 
glass of water. There are entropy increasing processes by which a glass of 
water can be turned into a glass containing an ice cube. In the limiting case, 
of reversible quasistatic processes, we can go back and forward between ice 
cube and water, thermodynamically reversibly. 

The same is equally true in an entropy decreasing universe. In such a 
universe there would also be entropy decreasing processes by which glasses 
of water could be converted into ice cubes in glasses and ice cubes in glasses 
converted into glasses of water. 

The asymmetry in the process, with which we are familiar, is not the 
fact that an ice cube is succeeded by water, but is in the process by which 
it happens. It is the non-equilibrium nature of the process that reveals the 
entropic direction. It is the fact that the ice cube is in the process of melting 
that tells us the 'correct' direction of the film. 

The generalisation of the arguments Section [3]4] is that any process, which 
can be defined solely in terms of a (deterministic or probabilistic) succession 
of QSES, can occur in an entropy increasing universe and in an entropy 
decreasing universe. What distinguishes the two universes is not a possible 
succession of QSES, but rather the processes by which the transitions between 
the states can take place. This suggests that, if one is to find connections to 
an entropic arrow of time, we should not be looking at the QSES that are 
the thermodynamically reversible limit for information processing systems. 
Any process which can be defined solely in terms of such states can occur in 
either entropic direction. 

The existence of Non-Equihbrium Steady States (NESS), on the other 
hand, are not time symmetric. Complex biochemical structures that arise 
in far from equilibrium conditions are associated with fundamentally time 
asymmetric, entropy increasing processes. The time reverse of these processes 
in entropy decreasing universes will lead to a different sequence of NESS, 
entropy decreasing processes. These complex structures are also the building 
blocks from which the biological processes are constructed that are necessary 
to house the information gathering and utilising systems. 

A generalisation of this may be conjectured: any time asymmetry that 
is supposed to be a consequence of the thermodynamic time asymmetry, 
cannot be expressed solely in terms of sequences of QSES. If we are to find 
stable states whose time asymmetry is a consequence of thermodynamics, 
their properties must come from NESS, not QSES. This suggests that the 
ideas of complexity, rather than information, are needed. 

6 Conclusion 

The argument of this paper is that an arrow of time associated with infor- 
mation processing systems cannot be deduced from thermodynamic argu- 
ments. The thermodynamic arrow is insufficient to entail the computational 
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arrow. Any sequence of logical operations in an entropy increasing universe is 
physically possible in an entropy decreasing universe. Landauer's Principle, 
as it is commonly stated, assumes statistical mechanical principles that are 
equivalent to being in an entropy increasing universe. If one changes those 
assumptions, so that one is in an entropy decreasing universe, a critical in- 
equality in Landauer's Principle in reversed. The physical implementation 
of logical operations, which increase entropy, do so, not by virtue of any 
inherent properties of the logical operation, but by virtue of being in an en- 
tropy increasing universe. If the same logical operation is performed in an 
entropy decreasing universe, it is entropy decreasing. As a result, entropy 
decreasing universes are not inherently hostile to the acquisition, persistence 
or utilisation of information. 

In principle, the operation of acquiring information can be made ther- 
modynamically reversible. This is precisely one of the main insights of Lan- 
dauer's work on the thermodynamics of computation: a measurement can 
take place without generating heat (see [36ll24] and many references within). 

Landauers principle, while perhaps obvious in retrospect, makes it 
clear that information processing and acquisition have no intrinsic, 
irreducible thermodynamic cost [25] 

If the acquisition of information can take place in a thermodynamically neu- 
tral manner, it can take place in an entropy decreasing as easily as an entropy 
increasing universe. 

While any information gathering and utilising system will ultimately cease 
to function in an entropy decreasing universe that reaches a final extremal 
entropy state, this doesn't seem sufficient to rule out such system^. Firstly, 
the decrease in entropy is due to the decorrelation that comes about from 
losing microcorrelations. It is of a different kind to the macrocorrelations 
that arise during the acquisition of information. Secondly, on the timescales 
during which information gathering and utilising systems work, between the 
low or high entropy extremal starting and ending points, there seems nothing 
to directly prefer IGUS over RIGU S. Thirdly, if the effect of the initial or 
future boundary conditions is screened off by the local entropy gradient, the 
no correlation, no interaction argument does not seem to be applicable, as 
such an entropy gradient can exist in a situation with no initial or final 
boundary condition. 

The suggestion is made that an entropic arrow of time will never be found 
in processes that can be defined solely in terms of a succession of Quasi- 
Static Equilibrium States. Information processing can be so defined. If the 
psychological arrow of time is to be aligned with the thermodynamic arrow, 
it cannot be through the information processing properties of the brain. It 
may be through the biochemical structures that arise in Non-Equilibrium 
Steady State processes, but if so, it is certainly not through any information 
processing characterisation of such structures. This would seem to imply that 
at least one aspect of conscious experience cannot be logically supervenient 
on the states of a computer. If instead the psychological arrow of time does 

^ Quite aside from the fact that it must also ultimately cease to function in an 
entropy increasing universe. 
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indeed arise out of information processing properties, this would mean that 
the psychological arrow is logically independent of the thermodynamic arrow 
of time. 
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